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Abstract 

This article gives dual representations for convex integral functionals 
on the linear space of regular processes. This space turns out to be a Ba¬ 
nach space containing many more familiar classes of stochastic processes 
and its dual can be identified with the space of optional Radon measures 
with essentially bounded variation. Combined with classical Banach space 
techniques, our results allow for a systematic treatment of stochastic opti¬ 
mization problems over BV processes and, in particular, yields a maximum 
principle for a general class of singular stochastic control problems. 

Keywords, regular process; integral functional; conjugate duality, singular 
stochastic control 
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1 Introduction 

This article studies convex integral functionals of the form 

EI h (v) = E f h t (v t )dnt 

Jo 

defined on the linear space V} of regular processes in a filtered probability space 
(0, F, (JFt)t>o, P)- Here /i is a positive optional measure on [0,T] and h is a 
convex normal integrand on P x [0, T] x R d . An optional cadlag process v of class 
(D) is regular if Ev T » —> Ev T for every increasing sequence of stopping times t " 
converging to a finite stopping time r or equivalently (see IDM821 Remark 50d]), 
if the predictable projection and the left limit of v coincide. Regular processes 
is quite a large family of stochastic processes containing e.g. continuous adapted 
processes, Levy processes and Feller processes as long as they are of class ( D). 
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A semimartingale is regular if and only if it is of class (D) and the predictable 
BV part of its Doob-Meyer decomposition is continuous. 

Inspection of [Bis78j reveals that TZ 1 is a Banach space under a suitable 
norm and its dual may be identified with the space A4°° of optional random 
measures with essentially bounded variation. Our main result characterizes the 
corresponding conjugate and subdifferential of Elh under suitable conditions on 
the integrand h. Our main result applies, more generally, to functionals of the 
form Elh + dRi(D), where 7 Z 1 (D) denotes the convex set of regular processes 
that, outside an evanecent set, take values in D t (uj) := cldom/i t (-,cc). Here, as 
usual, <5#i(£>) is the indicator function of 1Z 1 (D) taking the value 0 on 1Z 1 (D) 
and +oo outside of 7 Z 1 (D). 

Our main result allows for functional analytic treatment of various stochas¬ 
tic optimization problems where one minimizes an integral functional over the 
space of BV-processes. Our original motivation came from mathematical fi¬ 
nance where BV-processes arise naturally as trading strategies in the presence 
of transaction costs. In this paper, we give an application to singular stochastic 
control by deriving a dual problem and a maximum principle for a fairly general 
class of singular control problems and extends and unifies singular control mod¬ 
els of e.g. [BS771IEK811 IBSW811 ILS86] , Applications to mathematical finance 
will be given in a separate article. 

This paper combines convex analysis with the general theory of stochastic 
processes. More precisely, we employ the duality theory of integral functionals 
on the space of continuous functions developed by IRoc71bl combined with Bis¬ 
mut’s characterization of regular processes as optional projections of continuous 
stochastic processes; see lBis78j . Our main result states that if the conjugate 
h* of h is the optional projection of a convex normal integrand that allows for 
Rockafellar’s dual representation of Ih scenariowise, then under mild integrabil- 
ity conditions, the dual representation of Elh + $i z 1 (D) is given simply as the 
expectation of that of Ih +Sc(d), where C(D) denotes the continuous selections 
of D. The proof is more involved than the classical results on integral function¬ 
als on decomposable spaces or on spaces of continuous functions. To treat the 
space of regular processes, techniques from both cases need to be combined in 
a nontrivial way. Our proof is based on recent results on optional projections 
of normal integrabs from IKP161 and conjugate results for continuous functions 
from fPCTl7l . 


2 Integral functionals and duality 

This section collects some basic facts about integral functionals defined on the 
product of a measurable space (S, A) and a Suslin locally convex vector space 
U. In the applications below, S is either II, [0,T] or It x [0,T]. Recall that a 
Hausdorff topological space is Suslin if it is a continuous image of a complete 
separable metric space. We will also assume that U is a countable union of 
Borel sets that are Polish spaces in their relative topology. Examples of such 
spaces include separable Banach spaces as well as their topological duals when 


2 

















equipped with the weak*-topology. Indeed, such dual spaces are Suslin |Tre671 
Proposition A.9] and their closed unit balls are metrizable in the weak*-topology 
by [DS881 Theorem V.5.1], compact by the Banacli-Alaoglu theorem, and thus 
separable by [ DS88 , Theorem 1.6.25]. 

A set-valued mapping S : S =1 U is measurable if the inverse image S' -1 (O) := 
{£ G 5 | S(£) fl O ^ 0} of every open O C S is in A. An extended real-valued 
function / : U x S —>■ R is said to be a normal integrand if the epigraphical 
mapping 

£ ^ epi /(•, £) := {(u,a) eU x R| f(u, £) < a} 

is closed-valued and measurable. A normal integrand / is said to be convex 
if /(')£) is a convex function for every ^ £ H. A normal integrand is always 
B(U ) ® A-measurable, so £ /(«(£),£) is A-measurable whenever u : S —»• U 

is A-measurable. Conversely, if (S, A) is complete with respect to some cr-finite 
measure m, then any B(U) <8 ^l-measurable function / such that /(•,£) is lsc, 
is a normal integrand; see Lemma II71 in the appendix. Note, however, that the 
optional a -algebra on fl x [0,T] is not complete liaiihO . so we cannot always 
use this simple characterization when studying integral functionals of optional 
stochastic processes. 

Given a normal integrand and a nonnegative measure m on (5, A) the asso¬ 
ciated integral functional 

I fW) ■= J ^ f(u(€),£)dm(£) 

is a well-defined extended real-valued function on the space L°(E,A,m;U) of 
equivalence classes of U- valued A-measurable functions. Here and in what fol¬ 
lows, we define the integral of a measurable function as +00 unless the positive 
part of the function is integrable. This convention is not arbitrary but specifi¬ 
cally suited for studying minimization problems involving integral functionals. 
The function If is called the integral functional associated with the normal 
integrand /. If / is convex, If is a convex function on L°(2, A, m; U). 

Normal integrands are quite general objects and they arise naturally in var¬ 
ious applications. We list below some useful rules for checking whether a given 
function is a normal integrand. When U is a Euclidean space, these results can 
be found e.g. in |Roc76l IRW98] . For Suslin spaces, we refer to the appendix. 

A function / : UxS ->-Risa Caratheodory integrand if f {■,£,) is continuous 
for every £ and f(u, •) is measurable for every u € U. Caratheodory integrands 
are normal; see Proposition [T5] in the appendix. If S : S =4 U is a measurable 
closed-valued mapping then its indicator function 


8s{u,£) 


0 if u G S(£) 

+00 otherwise, 


is a normal integrand. 

Many algebraic operations preserve normality. In particular, pointwise sums, 
recession functions and conjugates of proper normal integrands are again normal 
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integrands; see Lemma [TH] in the appendix. Recall that the recession function 
of a closed proper convex function g is defined by 


g°°(u) = sup 


a>0 


g{u + au) - g(u) 
a 


where the supremum is independent of the choice of u in the domain 


dom g •= {u \ g(u ) < 00 } 


of g; see JRoc66l Corollary 3C]. 

When U is in separating duality with another linear space Y, the conjugate 
of g is the extended real valued function g* on Y defined by 


9*{y) = sup {(u,y) - g(u)}. 


ueu 


In particular, the conjugate of the indicator function 5s of a set S C U is the 
support function 

&s(y ) := sup (u,y) 
ues 

of S. If 5 is a cone, then as = 5s *, where 

S*:={yey|(u,y><OV U eS}, 

the polar cone of S. When g is closed and proper, the biconjugate theorem says 
that g = g**. This implies, in particular, that if g is closed and proper its 
recession function can be expressed as 



( 1 ) 


2.1 Integral functionals on decomposable spaces 

A space U C L°( S, A, m; U) is decomposable if 


^ Id 


whenever u Gld, A G A and u! G L°(s, A, to; U) is such that the closure of the 
range of u' is compact. The following result combines the results of Rockafel- 


lar |Roc681lRoc71al with their reformulation to Suslin spaces by Valadier [Val75] . 

Theorem 1 (Interchange rule). Assume that U = R d or that A is m-complete. 
Given a normal integrand f on U, we have 



as long as the left side is less than + 00 . 
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The interchange rule is convenient for calculating conjugates of integral func¬ 
tionals on decomposable spaces. Assume that Y is a Suslin space in separating 
duality with U and assume that y C L°(S, A, m; Y) is a decomposable space in 
separating duality with U under the bilinear form 



The first part of the following theorem is Valadier’s extension of Rockafellar’s 
conjugation formula to Suslin-valued function spaces; see |Val75j . For a convex 
function g on U, y G Y is a subgradient of g at u if 


g(u') > g(u) + (u' — it, y) Vit' G U. 


The set dg(u) of all subgradients is known as the subdifferential of g at u. We 
often use the fact y G dg(u) if and only if 


g(u) + g*{y) = {u,y). 


For a normal integrand / and for any u G L°(S, A, m; U ), we denote by df(u ) 
the set-valued mapping £ i-»- 3/(it(£), £), where the subdifferential is taken with 
respect to the it-argument. 

Theorem 2. Assume that U = M. d or that A is m-complete. Given a normal 
integrand f on U, the integral functionals If and //* on U and y are conjugates 
of each other as soon as they are proper and then y G dig (it) if and only if 


y G df(u) m-a.e. 


while (If) 00 = f/°°. 

Proof. The first claim is the main theorem of jVal75j . When If and If* are 
conjugates of each other, then y G dlf(u ) if and only if 


I f( u ) + I f*(v) = ( u ,v) 


which, by the Fenchel inequality /(it) + f*(y) > ( u,y ), is equivalent to 


f(u) + f*(y) = (u,y) m-a.e. 


which in turn means that y G df(u) m-almost everywhere. 

To prove the recession formula, let u G dom If and y G dom If*. We have 
f(u,£) > {u, — f*(y(Q,£) so the function f(u + u) — f(u) has an integrable 

lower bound. By convexity, the difference quotient 


/(it + au) - f (it) 


a 
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is nondecreasing in a, so monotone convergence theorem gives 


(/,-)(«) = / lim /(« + «“)- /(°) dm 
i=a/oo a 


= lim 

a oo t 

= lim 

a /* oo 

= (J/)°°(u), 


/(« + era) - f(u) 


dm 


a 


If(u + au) - If {u ) 


where the first and the last equation hold since /(•,£) and If are lower semi- 
continuous; see |Roc661 Corollary 3C]. □ 


2.2 Integral functionals of continuous functions 

Consider now the case where U = M. d equipped with the Euclidean topology 
and S is a compact interval [0, T]cl equipped with the Borel sigma-algebra 
and a nonnegative Radon measure /i with full support, i.e., supp/i = [0,T]. 
This section reviews conjugation of convex integral functionals on the space C 
of R -valued continuous functions on an interval [0, T]. Recall that under the 
supremunr norm, C is a Banach space whose dual can be identified with the 
linear space M of (signed) Radon measures 9 through the bilinear form 



Here and in what follows, the domain of integration is [0,T] unless otherwise 
specified. 

Given a normal integrand h on K. d x [0, T], consider the integral functional 
functional Ih on C. The space C is not decomposable so one cannot directly 
apply the interchange rule to calculate conjugate of Ih- Rockafellar [Roc 7lb1 
and more recently Perkkio [Perl41 IPerl7l gave conditions under which 

(■ Ih)* = Jh *, ( 2 ) 

where for a normal integrand / on !r x [0,T], the functional Jf : M —> M is 
defined by 


J f (0) = J M(d9 a /dfi) t )dfi t + J fr((de s /d\e s \) t )d\e s \ t , 

where 9 a and 9 s are the absolutely continuous and the singular part, respectively, 
of 9 with respect to /i and |0 S | is the total variation of 9 s . From now on, we 
omit the time index and write simply 

j f (9) = J f(d0 a /dn)dn + J f°°(de s /d\9 s \)d\e s \. 
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The validity of © depends on the behavior of the set 

D t := cldomht 

as a function of t. Recall that a set-valued mapping S from [0,T] to is inner 
semicontinuous (isc) if {t \ St (~l O ^ 0} is an open set for any open O; see 
[RW981 Section 5B], We will use the notation d s h t := d6n t ■ More explicitly, 
x £ d s h t {v) means that v £ D t and 

(x, v' — v) < 0 Vi/ £ D t , 

i.e. d s h t (v ) is the normal cone to D t at v. Given a v £ C, we denote the 
set-valued mapping 1 1 ->- d s ht{vt ) by d s h(v). The following is from IPerl7j . 

Theorem 3. Assuming Ih + 5c(d) an d Jh* are proper, they are conjugates of 
each other if and only if donah is isc and C(D) = cl(dom//j fl C(D)), and then 
9 £ d(I h + S C (D))(y) If and only if 

d9 a /dp £ dh(y) p-a.e., 
d6 s /d\9 s \ £ d s h(y) \6 s \-a.e. 

The conditions of the theorem have been analyzed in [Per 171 . The inner semi¬ 
continuity condition goes back to the continuous selection theorems of Michael 
jMic56 .. The domain condition C{D) = cl(dom Ih nC'(D)) holds automatically, 
in particular, if h is an indicator function. The condition means that dom/^ is 
dense in C{D). For example, for h t {v) = v/t, t > 0, and the Lebesgue measure, 
the condition is satisfied if and only if ho(v) = <5{o}(v)- 


3 Integral functionals of continuous processes 

For the remainder of this paper, we fix a complete probability space 

This section studies integral functionals on the Banach space T 1 (G) of random 

continuous functions v with the norm 

IMIlrc) : = E SU P Kl- 

te[o,T] 

Here and in what follows, E denotes the integral with respect to P (expectation). 
The results of this section will be used to derive our main results on integral 
functionals of regular processes 

We endow the space M of Radon measures with the Borel sigma-algebra 
associated with the weak*-topology and we denote by L°°(M) the linear space 
of M-valued random variables 9 with essentially bounded variatiorQ. The total 
variation of a 9 £ M will be denoted by || • \\tv- The first part of the following 
is from |Bis781 Theorem 2]. 

1 By usual monotone class arguments, the elements of are random Radon measures 

in the sense of [DM821 . 
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Theorem 4. The Banach dual of L l (C) may be identified with L°°(M) through 
the bilinear form 

( v , 9) := E J vd9. 

The dual norm on L°°(M) can be expressed as 

ll^llL°°(M) = ess sup ||0 ||tv- 
Proof. By Lagrangian duality, 

\\9\\l°°(m) = sup{(0, v) | E\\v\\ c < 1} 

= inf sup[(0,v) — A-E||u||c + A] 

AGM_)_ y 

= inf {E6b{8/\) + A} 

A£M_i_ 

= ess sup \\9\\tv, 

where B is the closed unit ball of the total variation norm and the third equality 
follows from Theorem [2] □ 

We will study integral functionals associated with normal integrands that 
are defined for each u> £ fl as integral functionals on C and M. Both C and M 
are countable unions of Borel sets that are Polish spaces in the relative topology, 
so we are in the setting of Section [2] We allow both the integrand h and the 
measure p to be random. More precisely, we will assume that p is a nonnegative 
random Radon measure with full support almost surely and that h is a convex 
normal integrand on x S, where S = fl x [0, T] is equipped with the product 
sigma-algebra T <g) £>([0,T]). We define Ih : C x —>• R, C(D) : C and 

Jh * : M x 12 — y M by 

I h (v,u) := I h (., u )(v), 

C(D)(w) := C(D(w)), 

Jh*(0,ui) := Jh*(-,u)(0), 
where the right sides are defined as in Section 12.21 

Lemma 5. If (w,f) D t (uj) is measurable, closed-valued and isc, then C(D) 
is measurable and closed-valued. 

Proof. That C{D) is closed-valued is evident. By (Roc71al Theorem 1], it suf¬ 
fices to show that w d{v,C(D{uj))) is measurable for every v £ C. We have 

d(v, C{D(ui))) = inf sup \w t — v t \ 
weC(D(ui)) t g[o,T] 

> sup inf \wt — Vt\ 
te[o,T] weC(D(ui)) 

= sup inf \w — vt\ 
te[o,T] w £ D t(u) 

= sup d(v t , AM) =: r(u>), 
te[o,T] 
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where the third equality follows from the inner semicontinuity. On the other 
hand, fixing an e > 0 and defining Sf(u) := B r ( w )+ e (ut) ) the mapping t e-> 
D t (oj) fl S't(w) is isc, by |Per 171 Theorem ??]. By Michael’s selection theorem, 
it admits a continuous selection w, so 

d(v, C(D(lj ))) < r(co) + e. 

Since e > 0 was arbitrary, we must have 

d(v, C(D(u>))) = sup d(v t ,D t (ui)). 

i£[0,T] 

Bv IRW981 ProDOsition 14.471. the measurability of D imolies that (w,t) 
d(v t , D t (oj)) is measurable. The measurability of d{v,C{D{uj))) now follows 
from |CV771 Lemma III.39]. □ 

Lemma 6. If h(u>) satisfies, for P-almost every to, the conditions of Theorem [3 
then Ih + $c(D) an d Jh * are normal integrands conjugate to each other. 

Proof. By Theorem [3] I hi:-, w) + dc(D(u) and (-,(*;) are conjugate to each 
other almost surely. The uniform topology on C satisfies both (a) and (b) of 
Theorem 1201 in the appendix, so Ih is a normal integrand. By Lemma [5j 5c(d ) 
is a normal integrand as well, so Ih + Sc(D) and Jh * are normal integrands by 
Lemma 02] in the appendix. □ 

By Lemma [G] and Lemma [171 the integral functionals Elh : L 1 (C) —> R 
and EJh * : L°°(M) —^ R are well defined. An application of the interchange 
rule Theorem [l] and Lemma [6] now gives expressions for the conjugate and sub- 
differential of E[Ih + dc(.D)]- Recall the notation for the subdifferential mapping 
from Section EU 

Theorem 7. If h(io) satisfies, for P-almost every u>, the conditions of The¬ 
orem 0 then the convex functions E[Ih + <5c(r>)] : L 1 (C) —> R and EJh * : 
L°°(M) —> R are conjugate to each other as soon as they are proper and then 
9 € dE[I h + S C (d)]{v) if and only if 

dO a /dfi € dh(v) /.i-a.e., 
d9 s /d\9 s \ G d s h{v) |0 s |-a.e. 


almost surely. 

Proof. Theorem [2] and Lemma 0 give 

(E[I h +6 c(D) }r(9) = E[I h + 5 c{D) ne) = EJ h ,(0). 

The subgradient characterization now follows from Theorems 0 and 0 

□ 
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4 Regular processes 

Let (J 7 t )t >o be an increasing sequence of cr-algebras on that satisfies the usual 
hypotheses that T t = fV>t -At' and To contains all the P-null sets. We denote 
by T the set of stopping times, that is, functions r : LI —»• [0, T] U {+00} such 
that {t < t} £ Tt for all t £ [0,T]. A process is optional if it is measurable 
with respect to the a-algebra generated by right-continuous adapted processes. 
If v is T-integrable in the sense that v T is integrable for every t £ T, then, 
by |HWY921 Theorem 5.1], there exists a unique (up to indistinguishability) 
optional process °v such that 

E[v t 1{ t<oc } I Tt] = Vl{r<oo} P- a.s. for all r <E T. (4) 

The process °v is called the optional projection of v. In particular, every v £ 
L 1 (C) has a unique optional projection. 

We will denote by 77 1 the space of regular processes , i.e., the optional cadla£@ 
processes v of class ( D ) such that Ev T v —> Ev T for every increasing sequence 
of stopping times t v converging to a finite stopping time r or equivalently (see 
[DM82 ; . Remark 50d]), such that the predictable projection and the left limit of 
v coincide. Recall that a process v is of class ( D ) if {u T | r £ T} is uniformly 
integrable. By |Bis78l Theorem 3], the optional projection is a linear surjection 
of L\C) to 77 1 '. 

Remark 1. An optional cadlag process v of class (D ) is in IZ 1 , in particular, 
if it is quasi left-continuous in the sense that lim v T » = v T almost surely for any 
strictly increasing sequence of stopping times (r v )ffL 1 with t v r. Conversely, 
if the filtration {Tt)t> 0 is quasi-left continuous then quasi left-continuous pro¬ 
cesses of class (D) are regular; see I 'DM82 , Remurk 50. (d)] and fHWY92\ The¬ 
orem 4-34]- Continuous adapted processes, Levy processes flHWY92[ Theo¬ 
rem 11.36]) and Feller processes •' Knit) 2 . Proposition 22.20]) are quasi left- 
continuous. A semimartingale v is regular if and only if it is of class (D) and 
has a decomposition v = m + a where m is a local martingale and a is a contin¬ 
uous BV process. Indeed, a semimartingale of class ( D ) is special so the claim 
follows from f DM821 Remark VII.24(e)]. 

We will denote by M°° C L°°(M ) the space of essentially bounded optional 
Radon measures on R d , i.e. the elements 0 £ L°°(M ) such that 

E J vdO = E J °vdO Vv £ L\C). 

The following result, essentially proved already in Bismut [ Bis78l . shows that 
M°° may be identified with the Banach dual of IZ 1 . 

Theorem 8. The space IZ 1 is a Banach space under the norm 

IMk 1 : = supP|u T | 
reT 

2 right-continuous with left limits 
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and its dual may be identified with M.°° through the bilinear form 

(v,9)-jii = E J vd9. 

The dual norm can be expressed as 

\\Q\\m°° = ess sup ||0 ||tv- 

Proof. Since the optional projection is a surjection from Lf{C) to 77 1 , it defines 
a linear bijection from the quotient space L 1 (C)/A' to TZr. Here K denotes the 
kernel of the projection. For any v € L}(C), Jensen’s inequality gives 

II °v\\tV- = supE\E[v T \T t ]\ < sup.E|u T | < ||u|| L l(C) (5) 

tGT tGT 

so the optional projection is continuous. In particular, K is closed in F 1 (C) so 
L 1 (C)/iF is a Banach space under the quotient space norm 

\MWl^(C)/k ■= jnf. \\v + v'\\ L i (C). 

On the other hand, for each w € TZ 1 and e > 0, (Bis781 , Theorem 3] gives 
the existence of a v £ L X (C) such that w = °v and ||u||ii(c) < ||iu||t^i + e. 
Thus, ||[u]||ii(c 7 )/if < || °u|| 7 J 1 which together with ([5]) implies that the optional 
projection is an isometric isomorphism from the quotient space L 1 (C')//i to 
7 Z 1 . It follows that 7 Z 1 is Banach and, by |Bis781 Proposition 2], its dual may 
be identified with .Ad 00 . As to the dual norm, 

|| 0 || 7 Koo = sup {(u, 9) | ||u|| w i < 1 } 

uEK 1 

= sup {<U,0> | ||u|| L i (C) < 1}, 
veL'ic) 

where the second equality comes from the isomorphism of 7Z 1 and L l (C)/K. □ 

Theorem [5] complements the results of [DM821 Section 7.1.4] on Banach 
duals of adapted continuous functions and adapted cadlag functions under the 
supremum norm. The dual space of adapted continuous functions consists of 
predictable random measures with essentially bounded variation whereas the 
dual of adapted cadlag functions is given in terms of pairs of optional and 
predictable random measures with essentially bounded variation; see [DM821 
Theorem VII.67]. In the deterministic case, Theorem [8] reduces to the familiar 
Riesz representation of continuous linear functionals on the space of continuous 
functions (the duality between C and M ). 

The norm |j ■ || TC i in Theorem [ 8 ] is studied in [DM821 Section VI], where a 
general measurable process v is said to be “bounded in L 1 ” if ||v||-r.i < oo; see 
[DM821 Definition VI.20]. It is observed on p. 82-83 of IDM82] that a sequence 
converging in the TT^-norm has a subsequence that converges almost surely in the 
supremum norm. Moreover, by DM821 Theorem VI.22], the space of optional 
cadlag processes with finite 7^ 1 -norm is Banach. Theorem [ 8 ] implies that regular 
processes form a closed subspace of this space. 
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5 Integral functionals of regular processes 


This section gives the main result of this paper. Given a normal integrand h 
and a random measure /i as in Section [3J it characterizes the conjugate of a 
convex integral functional of the form 


EI h (v) = E 


h(y)dg 


on the space 1Z 1 of regular processes. Note that TZ 1 is not a decomposable 
space nor are the paths of a regular process continuous in general, so we are 
beyond the settings of Sections [2] and [3] Nevertheless, the functional Elh is 
well-defined on 1Z 1 since h(v) is an extended real-valued measurable process for 
every v £ 7 Z 1 1 so T('u) is T -measurable by Lemma I2T1 in the appendix. 

Our main result, Theorem [9] below, requires some additional properties on 
g and h. As to g, we assume that it is optional , i.e. that 

E j vdg = E J °vdg 

for every nonnegative bounded process v. The normal integrand h will be as¬ 
sumed “regular” in the sense of Definition Q] below. The definition involves the 
notion of the optional projection of a normal integrand that we now recall; see 
lKPl6| . 

A normal integrand g on x Q x [0, T\ is said to be optional if its epigraph 
epi gt(■, to) is measurable with respect to the optional sigma algebra on S2 x [0, T]. 
If g is a convex normal integrand such that g*(v) + is T-integrable for some T- 
integrable v then, by |KP16 . Theorem 6], there exists a unique optional convex 
normal integrand °g such that 

°g{x) = °[g{x)\ (6) 

for every bounded optional process x. Here we use the notion of optional projec¬ 
tion of an extended real-valued process; see the appendix. The normal integrand 
°g is called the optional projection of g. Clearly, an optional normal integrand 
is the optional projection of itself. In the linear case where g(x,to) = Vt{to) ■ x 
for a measurable T-integrable process v, we simply have °gt{x,u>) = °Vt(to) ■ x. 

We will use the abbreviation a.s.e. for “P-almost surely everywhere on 
[0,T]”, that is, outside an evanescent set. 

Definition 1. An optional convex normal integrand h on is regular if h* = 
h* for a convex normal integrand h such that h(ui) satisfies, for P-almost every 
u, the conditions of Theorem [3] and 

h(y) > v ■ x — a a.s.e. 
h*{x) > v ■ x — a a.s.e. 

for some v £ L 1 {C ) with v £ C(D) almost surely, optional x with f \x\dg £ L°° 
and some T-integrable a with f \a\dg £ L 1 . 
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Before commenting on Definition [T] we state the main result of this paper, 
which characterizes the conjugate and the subdifferential of an integral func¬ 
tional on TZ 1 . Since TZ 1 is not decomposable, we cannot directly apply the 
interchange rule in Theorem |T| Instead, the idea is to apply the interchange 
rule to T h on T 1 (C) and to use properties of optional projections of normal 
integrands from |KP16j . The proof is given in the appendix. 

Theorem 9. If h is a regular convex normal integrand, then Elh + &r1(.d) : 
1Z 1 —>■ R and EJh * : A4°° —» R are proper and conjugate to each other and, 
moreover, 9 £ d(EIh + S-^i (£>)) (v) if and only if 

d9 a /dp £ dh(v) g-a.e., 
dO s /d\d a \£d s h{v) \9 s \-a.e. 


almost surely. 

In the deterministic case, Theoremjnigives sufficiency for Theorem^ Indeed, 
we then have TZ 1 = C and one can simply take h = h in Definition |T] Note 
that, in general, the assumptions in the Theorem [3] do not imply that Jh* is a 
normal integrand on M xfl. For example, in the linear case h*(x,ui) = v t (uj) -x, 
the function (•,<*;) is a(M,C)- lower semicontinuous on M if and only if v 
has continuous paths (since C is the topological dual of M under the weak* 
topology cr(M, C)). 

Theorem [9] simplifies when h is real-valued. 

Corollary 10. Let h be a real-valued optional convex normal integrand such 
that Elh is finite on T 1 (C) and 

h(v ) > v ■ x — a, 
h*{x) > v ■ x — a 

for some v £ L 1 (C), optional x with f \x\dp, £ L°° and some T-integrable a 
with f \a\dp £ L 1 . Then Elh ■ TZ 1 —> R and EJh> '■ M°° R are proper and 
conjugate to each other and, moreover, 9 £ dEIh(v) if and only if 9 <C p 

d9 a /dp £ dh{v) p-a.e. 

almost surely. Moreover, Elh is continuous throughout TZ 1 . 

Proof. Our assumptions imply that Ih is finite on C almost surely. Thus we 
may choose h = h in Definition [TJ so /z. is regular. The first part thus follows 
from Theorem [9] and the fact that d s h(v) = {0} for a finite h. It remains to 
show that Elh is continuous. As in the proof of Theorem [9] in the appendix, we 
see that EIh(°v ) < Elhiv) for every v £ T 1 (C). Thus, Elh is finite on TZ 1 , so 
the continuity follows from |Roc741 Corollary 8B] since TZ 1 is Banach. □ 

We say that a measurable closed convex-valued mapping S is regular if its 
indicator function 5s is regular in the sense of Definition [l] In particular, a 
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convex-valued isc optional mapping S that admits an i 1 (C) selection is regular 
since then one can take h = 5s in Definition [lj When h = 6s, Theorem [9] can 
be stated in terms of the normal integrand defined pointwise by os t (x,co) := 

su P«eS,M x ■ v - 

Corollary 11. Let S be a regular set-valued mapping. Then 

S = {v £ 7Z 1 1 v £ S a.s.e.} 

is closed in 77 1 , 

o s {6)=E j aside/d\6\)d\e\ 

and 9 £ Ns(v) if and only if dQ/d\0\ £ Ns{v) \9\-a.e. almost surely. In particu¬ 
lar, if S is cone-valued, then S is a closed convex cone and 9 £ S* if and only 
if d0/d\6\ G S* \9\-almost everywhere P-almost surely. 

Regular set-valued mappings can be characterized in terms of optional pro¬ 
jections of set-valued mappings. If S admits a T-integrable a.s.e. selector then, 
by IK1 3 161 Theorem 10], there is a unique optional closed convex-valued map¬ 
ping °S such that oo S = °as ■ The mapping °S is called the optional projection 
of S. Note that if S t (oj) = {i> t (w)} for a T-integrable process v, we simply have 

°S t {u) = {°u t (w)}. 

Lemma 12. A closed convex-valued measurable mapping S is regular if and only 
if it is the optional projection of a closed convex-valued measurable isc mapping 
S that admits an L 1 (C) a.s.e. selection. In particular, a single-valued mapping 
St{u>) = {ut(a;)} is regular if and only if v is a regular process. 

Proof. If such an S exists, one can take h = in Definition [l] To prove the 
necessity, let h be a convex normal integrand in Definition [T] so that h* = os- 
By [KP161 Theorem 7], Since os is positively homogeneous, 

we get °[(/i*) 00 ] = os- On the other hand, by (fl}, ( h*)°° = f7 cldom ^) so we may 
choose S = cldom/i. 

Consider now the single-valued case and let v G L l (C) be a selection of S. 
We have Og, w Ax) > x ■ Vt(u>), so x ■ vt(ui) = °o s t fu,)(x) > x ■ °vt(u>)- Since this 
holds for all iGl* 1 , we must have v = °v. □ 

Example 1. A set-valued mapping is regular if it is a ’’martingale” in the sense 
that is the projection of a pathwise constant set-valued mapping that admits 
an L 1 (C) a.s.e. selection. Set-valued martingales in discrete time have been 
analyzed, e.g., in \HU7T\ [Hes02f . 

Example 2. Sets of the form S* in the last part of Corollary 1111 are used to 
describe financial markets in IKS091 Section 3.6.3], where it is assumed that 

S t (oj) := cocone{£ t fc (w) | k G N} 
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for a countable family (C fc )fceN of adapted continuous processes such that for each 
uj and t only a finite number of the vectors £ t fc (w) is nonzero. Such an S is auto¬ 
matically optional and isc and thus regular. Indeed, given a family of isc map¬ 
pings (r a ) their pointwise union is isc since (U a r a ) _1 (0) = U (l ((ra) _1 (0)) 
is open for any open O. Thus, S is isc and, by JRW9SI Proposition If .11 and 
Exercise If.12], it is also optional (even predictable). 

It is clear from the above argument that the assumption, that only a finite 
number of the generators is nonzero, is not needed for regularity. Indeed, the 
mapping 

St{uj) := clcocone{£ t fc (w) | k G N} 

is still regular. More generally, S is regular if is the optional projection of 
S t (uj) := clcocone{£ t fc (oi;) | k G N} 

for a countable family (C fe )fceN of (non-adapted) continuous processes. Corol¬ 
lary \13\ gives an extension to nonconical models. In discrete time, such models 
have been studied in IPP1 Of . 

Applying Theorem [9] to the case where h is support function of a closed 
convex-valued mapping gives the following. 

Corollary 13. Let S be an optional closed convex-valued mapping such that as 
is regular. Then 

C = {<9 G M°° | dO a /dp G S p-a.e., dd s /d\8 s \ G S°° \8 s \-a.e. P-a.s.} 
is closed in Ai°° and its support function has the representation 

ac{v) = E J a s {v)dg + 5^(0), 

where Dt(co) = cldom<rs t ( w ). 


6 Maximum principle in singular stochastic con¬ 
trol 


The space M of Radon measures may be identified with the space Xq of Re¬ 
valued left-continuous functions of bounded variation on M + which are constant 
on (T, oo] and Xo = 0. Indeed, for every x G Xq, there exists a unique Dx G 
M such that Xt = Dx([0,t)) for all i G I. Thus x ^ Dx defines a linear 
isomorphism between Xq and M. The value of x for t > T will be denoted by 
Xt+- Similarly, the space M°° may be identified with the space TV/q° of adapted 
processes x with x G Xo almost surely and Dx G M°°. 

Let g and h be optional normal integrands on R d and consider the stochastic 
control problem 


minimize 

ceL°° 

subject to 


E[I g (x) + e(x T ) + h*{u)\ 

+ / Budfi + Wt , 

Jo 
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where A,Bg R dxd and W £ L^iC) is optional. Here and in what follows, L p 
denotes the optional elements of the space L P (C1 x [0, T\, T ® B([0, T]), v; R d ), 
where v(A) := E/i(A). Denoting Zt '■= f^xdfj, and c* := J* ud/i, we can write 
the problem as 


minimize E[I„{z) + e(zr) + Ih * (c)] 

c£A%° 


subject to 


z 0 = 0, 

Zt = Azt + Bet + Wf, 


where ^4jj° denotes the space of optional processes with /.t-absolutely continuous 
paths and essentially bounded variation. The singular control problem is ob¬ 
tained by allowing c to be of bounded variation, not just absolutely continuous. 
The problem becomes 


minimize 


E[I g {z) + e(z T ) + Jh * {Dc)\ 


subject to 


z 0 = 0, 

it = Azt + Bet + Wt, 


where the functional Jh» : —> K is defined as in Section [5] 

In the one-dimensional case, with g(z) = ^rjzl 2 and 


h*(c) 


k\c\ — k 2 /A 


if |c| < /c/2, 
if |c| > k/2 


(SCP) 


for some nonnegative constants r and k , we recover a finite-horizon version of the 
singular stochastic control problem studied by Lehoczky and Shreve jLS861 (note 
that they wrote the problem in terms of the variables x = z). Whereas 1LS86I 
analyzed the Hamilton- Jacobi-Bellman equation associated with the above one- 
dimensional case, we use convex duality to derive a dual problem and optimality 
conditions in the general case. The optimality conditions come in the form of 
a maximum principle where the absolutely continuous and the singular parts of 
the optimal control are characterized as pointwise minimizers of the Hamiltonian 
and its recession function, respectively. 

We will relate problem (1SCPI) to the following dual problem 


minimize 

subject to 


Elg- (W*) + El* W ) + EI h (B t °p) + (D) (B t °p) 


Pt = -A T p t + w* t , 
PT = -V*, 


(DCP) 


where gt(x,oj) = gt(x + at, to), e(x,to) = e(x + clt) and at = / 0 * e < d~ s ' >A W s dp, s - 
We say that a normal ^-integrand / is integrable if f(x, •) G L 1 for all x £ R d . 
Combining Theorem [9] with the conjugate duality framework of |Roc74| yields 
the following. The proof is given in Section 16.11 below. 


16 










Theorem 14. Assume that the optimum value is finite, g and e are integrable, 
h is regular, and that J^*(0) G L 1 . Then inf (ISCPI) = — inf (IDCPI) and the 
infimum in flUIED is attained. Moreover, c G J\f§° attains the infimum in 
(ISCPI) if and only if there exist w* G L 1 such that pt G L 1 and, almost surely, 

dh(B T °p) 9 dc/dp p-a.e. 
d s h(B T °p) 0 dc s /\dc\ \Dc s \-a.e. 
dg(z) 9 w* p-a.e. 
de(z T ) 9 -pr, 

where z and p are the corresponding solutions of the primal and dual system 
equations. 

The optimality conditions in Theorem [14] can be written in terms of the 
Hamiltonian 


H t (z, c,p) := g t (z) + h* t (c) - p- (Az + Bc + W t ) 

much like in the classical Pontryagin maximum principle. Indeed, by |Roc71al 
Theorem 23.5], the first two subdifferential inclusions in Theorem [T3] mean that 

dc/dp G argminiJ(i, c, °p) p- a.e., 

C 

dc s /\dc s \ G argmin H°°(z,c, °p) |Dc s |-a.e., 

C 

where -,p) := H(-, ■,p)°°, while the third one implies that the dual state 

p satisfies the differential inclusion 

p G d z H(z,c,p) 

in symmetry with the primal system equation which can be written as 

i G d v \-H](z,c,p). 

The above conditions are reminiscent of the maximum principle derived in 
|CH9'1| for problems where the objective is linear in the singular part of the 
control. While the maximum principle of |CH94j characterizes optimal control 
processes as minimizers of a certain integral functional, the above conditions 
give explicit pointwise characterizations for both the absolutely continuous and 
singular parts. 

Example 3. Consider the problem 


maximize E 


Ut{c t )dp 


D t dc + Ut{ct ) 


overc G J\f£° with dc> 0, 


where U is a nondecreasing concave optional integrand, and D = D for some 
nonnegative nonincreasing cadldg process D. This is a finite horizon version of 
problem (17) in IB Kid, Theorem 3.1]. 
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This problem jits into (ISCPI) with d = 1, A = 0, B = 1, W = 0, gt{c,u>) = 
—Ut{c,iu), e = —Ut(c,uj) and 


ht(y,u) = 


Indeed, we then have 


K (c, w) = 


0 ify<D t (u), 

+oo otherwise. 


D t {to)c if c> 0, 

+oo otherwise, 


so (up to a change of signs) (ISCPI) reduces to the problem above. Moreover, h 
is regular. Indeed, defining 


we have 


ht(y,u) = 


h*(c,w) = 


0 ify<D t (u) 

+oo otherwise, 

\ -Dt Me if c> 0, 

I +oo otherwise 


and h* = °(h*). Since D is nonincreasing and cadlag, the distance function 
t i->- d(y,domht) is upper semicontinuous for every y £ M so dom h t is inner 
semicontinuous, by [RW981 Proposition 5.11}. 

The dual problem (IDCPI) becomes 


minimize E 


Vt(-pt)dp + V t (pt) 


over p e L 1 with °p < D, 


where V t (q) = (—U t )*(q). This corresponds to (11) of fBKlff ). The optimality 
conditions can be written as 


°p < D, Dc > 0, J( D ~ °p)dc = 0, 


Pt e d[-U t ]{c t )dp, 

Pt £ d[—U t\{ct). 

Assuming U is differentiable, these can be written as 


°P <D, Dc > 0, J(D- °p)dc = 0, 
p t = Ut{c t ) + £ U' t {ct)dp 


which are exactly the optimality conditions in fBKl 6\ Theorem 3.1]. 

Bank and Kauppila consider the case where, almost surely, ) is strictly 

convex, differentiable on (0, oo), satisfies the Inada conditions UffO, ui) = oo and 
lim^oo U}(c,ui) = 0, and U{c ) £ L 1 for every c £ M+. Theorem \l^ establishes 
the existence of a dual solution in the complementary case where U (c) G L 1 for 
every c £ R. 
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6.1 Proof of Theorem 1141 

Our proof is based on general results of Rockafellar I Roc741 on duality and 
optimality in convex optimization problems that here take the form 

minimize F(x,u ) over x £ Af£° , (P) 

where the parameter u belongs to a LCTVS U in separating duality with a 
LCTVS Y and F is a proper convex function on Afff° x U such that F(x, ■) is 
closed for every x £ Af§° . The associated Lagrangian 

L(x,y) := inf {F(x,u) - (u,y)} 

is an extended real-valued function on Af§° x Y, convex in x and concave in y. 
Denoting the optimum value of m by (p(u), we have 

V'fe* = - 

The following result, obtained by combining Theorem 17 and Corollary 15A of 
[Roc74(, suffices for us. 

Theorem 15. Assume that the optimal value function 

<p{u) = inf F(x,u) 

xGA/q ’ 0 

is proper and continuous on U. Then p = tp** and an x £ A /g° solves (jP]) if 
and only if there exists y £Y such that 

0 £d x L(x,y) and u £ d y [—L\(x, y). 

Lemma 16. For any c £ Af§°, the system equation of (ISCPIl has a unique 
solution given by 

z = Ac + a 

where Ac is the unique pathwise solution of 

(z 0 = 0, 

1 z t = Az t + Bc t . 


Denoting Ac := the linear mapping c (Ac, ( Ac)t) from Af£° to L°° x L°° 
is continuous and for each c £ jVq° and (w* , 77 *) £ L 1 x L 1 , we have 

((Ac, (Ac) t ), ( w*,if )) = {-B To p,Dc) n 1 , 

where p is the unique pathwise solution of 

ipT = ~V*, 

[Pt = -A T p t +Wt. 
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Proof. Given c E Af§° and ( w*,rf) G L 1 x L 1 , let z = Ac and let p be the 
corresponding solution to the dual system equation. Integration by parts gives 


{(Ac, (Ac) t ), (w*,V*)) 


E[ j z{A T p + p)dp - z T ■ Pt\ 

E[J p- (z- Az)dp - ( z T - Az t ) ■ pt] 
E[J p ■ Bedp. - { Bc t ) ■ Pt] 

—E f B T pdc 


- E J B t °pdc 
(~B T °p, Dc) n i. 


□ 


Using Lemma QjJ] we can write (1SCPI) as 

minimize E[Ig(Ac) + e{{Ac)x) + Jh* {Dc)] over cGA/J°, (7) 

Since a is an optional process, g and e are optional and J r -normal integrands, 
respectively. 

Proof of Theorem m Problem 0 fits the general conjugate duality framework 
with X = A7 0 °°, U = L°° x L°°, Y = L 1 x L 1 and 

F(c, u ) = E[Ig(Ac + w) + e((Ac) T + rj) + Jh*(Dc)\, 

where u = ( w,ri). Clearly 

<p(u) := inf F(c,u) < F(0,u) = E[Ig(w)+ e(r}) + J h .(Q)]. 
caM§° 

Since g and e are integrable, the last expression is Mackey-continuous on U ; see 
|Roc74l Theorem 22], By IRoc74i , Theorem 8], ip is then Mackey-continuous as 
well. We may thus apply Theorem 1151 

Denoting y = {w*,y*) and using the interchange rule, the Lagrangian can 
be expressed as 

L(c, y) = inf {E [[g(Ac + w) — w ■ w*]dp + E[e((Ac)T + v) ~ V ' ’?*]} + EJ h * ( Dc) 
u£U J 

= E J [Ac ■ w* — g*(w*)\dpi + E[(Ac)t • if — e*(if)] + EJ{Dc) 

= {{Ac, {.Ac) T ), {w* , if)) - EI § . {w*) - Ee*{ g*) + EJ h , {Dc). 

Bv LemmafTfil ({Ac, (Ac)t), (w*, rj*)) = (~B T °p, dc) R i, where p is the solution 
to the dual system equations. Theorem [9] now gives 

ip*{y) = - inf L{c, y) = EI r {w*) + Ee*{r,*) + EI h {B T °p), 

cGN§° 
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so the first claim follows from Theorem [15] 

Subdifferentiating the Lagrangian gives the optimality conditions 

dEJ h , ( Dc ) - P T 3 0, 

dEIg. ( w*)-Ac 3 0, 
dEe*(r]*) - ( Ac) T 3 0, 


or equivalently, 

d(EJ h t)*(B To p) 3 Dc, 
d(EIg,)*(Ac ) 3 10 *, 

d(Ee*n(Ac) T ) 3rf. 

Applying the subdifferential formulas in Theorem[2]and Theorem^ and recalling 
that g t (x,u>) = gt{x + at, to) and e(x,ui) = e(x + ap), gives the optimality 
conditions in the statement. □ 


7 Appendix 

7.1 Normal integrands on Suslin spaces 

This section proves the claims made in Section [2] concerning criteria for checking 
that a function / : U x S —>■ R is a normal integrand. For U = R d , these results 
are well known and can be found e.g. in |Roc76] and [KW981 Chapter 14]. 
Various extensions exist beyond the finite-dimensional case. Below, we allow 
for a locally convex Suslin space U which covers the function spaces studied in 
this paper. Note that Suslin spaces are separable since the image of a countable 
dense set under a continuous surjection is dense. 

Lemma 17. If (S,A) is complete with respect to some o-finite measure m, 
then any B(U) ® A-measurable function f such that f (-,£) is Isc, is a normal 
integrand. The converse holds if U is a countable union of Borel sets that are 
Polish spaces in the relative topology. 

Proof. Since / is measurable, the graph gph(epi/) of the set-valued mapping 
£ =1 epi /(•,£) is T ® B(U) ® B(R)-measurable, where B(U) ® B(M) = B{U x 
M) |Bog07t Lemma 6.4.2]. The space 17 x R is also Suslin |Bog07] Lemma 
6.6.5]. For any open O C U x M, the set gph(epi/) fl (12 x O) is measurable, 
so by the projection theorem |CV771 Theorem III.23], {w | 3(it,a) : (w,u,a) G 
gph(epi/) fl (fl x O)} belongs to T . 

To prove the converse, denote by P v the Borel sets in question. We have 
that B(P V ) coincides with B(U) fl P v , so / is jointly measurable if and only 
if its restriction /" := /|p- X f 2 is jointly measurable for each v. Since epi f v is 
a measurable closed-valued mapping from fl to P" x R, its graph is measur¬ 
able by ICV771 Theorem III.30], and thus, by [ iVal751 Lemma 7], /" is jointly 
measurable. □ 
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From now on we assume that U is a countable union of Borel sets that are 
Polish spaces in the relative topology. A function / satisfying the assumptions 
of the following proposition is known as a Caratheodory integrand. If (S, A) 
were complete w.r.t. some cr-finite measure to, the result would follow from 
(CRdFV04l Lemma 1.2.3] and Lemma [T71 

Proposition 18. If f : U x S —> K is such that /(•,£) is continuous for every 
f and f(u, •) is measurable for every u £ U, then f is a normal integrand. 

Proof. Let {u u \ v £ N} be a dense set in U and define oT ,9 (£) = f{u v ,£f) + q , 
where q £ Q+. Since /(•,£) is continuous, the set O = {(u, a) \ f(u,f) < 
a} is open. For any (u,a) £ epi/(■,£) and for any open neighborhood O of 
(u,a), O fl O is open and nonempty, and there exists (u v ,a v ' q ) £ O D O, i.e., 
{{u v ,oP' q (tf) | v £ N, q £ Q} is dense in epi/(■,£). Thus for any open set 
0€UxR, 


(e | epi /(., 0 n O ? 0} = (J{£ I («*'» ^ q (0) G O} 


is measurable. □ 

Given a proper lower semicontinuous function / and a nonnegative scalar a, 
we define 

( \ \af(x) if a > 0, 

( at)(x ) := < 

\<5cidom/(a0 if a = 0. 

Lemma 19. Let f, f l , i = 1 ,...,n be proper normal integrands on U and 
assume that (5, A) is complete w.r.t. a cr-finite measure or U = R d , then the 
functions 

1. (u, £) where a £ L°(S,R_(_), 

3. r defined by /°°(-,£) = 

4- f* defined by f*(-,f) = f (■,£)*, where Y is a Suslin space in separating 
duality with U 

are normal integrands. 

Proof. For U = R d , proofs can be found in [RW981 Chapter 14] except for part 
1. In this case, using properness of /(•,£), it can be shown that a(£)/(-,£) is 
the epigraphical limit of «"/(•,£) as a? \ a(f) (see |RW981 Chapter 7]), so the 
result follows from (RW981 Proposition 14.53]. 

When (5, A) is complete, it suffices to verify, by Lemma IT7l that the func¬ 
tions are jointly measurable and lower semicontinuous in the second argument. 
For 2, this follows from the fact that sums of measurable/lsc functions is again 
measurable/lsc. For 3, it suffices to note that /°° is a pointwise increasing 
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limit of jointly measurable functions that are lower semicontinuous in the sec¬ 
ond argument. Part 4 is from |Val751 Lemma 8]. To prove 1, note first that 
{(it,£) I /(«,£) < °°} is measurable, so one may proceed as in the proof of 
Lemma H3 to show that dom / is a measurable set-valued mapping. It follows 
that cl dom / is a measurable mapping as well, so <5 c idom/ is a normal integrand 
and thus jointly measurable by Lemma 1171 Since af = l a =o^cZdom/ + la>oQ ! /, 
we get, using part 2, that / is jointly measurable. □ 

7.2 Integral functionals as normal integrands 

Let U be a Suslin subspace of Borel measurable functions on [0, T] and consider 
the random integral functional Ih : U x £2 —>- R defined scenariowise by 

I h (u,uj) := I h {-,u,), 

where h and p are as in Section [3] That is, /i is a nonnegative random Radon 
measure with full support almost surely and h is a convex normal integrand 
on x H, where 3 = 12 x [0, T] is equipped with the product sigma-algebra 
T <g> £>([0,T]). The following result was used in Lemma[H]for U = C. 

Theorem 20. Assume that U is a countable union of Borel sets that are Polish 
spaces in the relative topology. The function Ih is B{U) ® J- -measurable under 
either of the following conditions: 

(a) The sequential convergence in U implies pointwise convergence outside a 
countable set and point-evaluations in U are measurable. 

(b) The topology on U be finer than the topology of convergence in p(ui)- 
measure almost surely. 

In such cases, Ih is a normal integrand on U whenever Ih{-,uj) is lower semi¬ 
continuous almost surely. 

Proof. We only give proof for the first set of conditions, the second case is 
similar. We may assume without loss of generality that h is bounded from below. 
Indeed, If Ih« is B(U ) <g) J r -measurable for h a = sup{/z, a} and a < 0, then, by 
the monotone convergence theorem (recall that by convention Ih(u,u >) = +oo 
unless Ih+(u,ui) < +oo), 


I h (u,w)= lirn I h c.{u,(jS), 

ot — y —oo 

and Ih is B(U) <g> ^-measurable as well. Assume first that p is an atomless 
random measure. 

Case 1 : Assume that a < h t (u,u:) < 7 for all (u,t,u) and that h t (-,oj) is 
continuous for all (u>, t). By the dominated convergence theorem and continuity 
of ht(-,u>), Ih(-,ui) is continuous in /i(w)-measure and thus continuous in U. For 
every u £ U, Ih(u, •) is measurable, since (t, w) 1 —>■ ht(ut, oj) is measurable (being 
a composition of measurable mappings) and p is a random Radon measure. By 
Proposition ITSl and Lemma [171 Ih is thus B{U) <S> ^-measurable. 
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Case 2: Assume that a < h t (u,oj) for all ( u,t,u ) and that is contin¬ 
uous for all By Case 1, for h 1 = min{h, 7 }, If (7 is B{U ) ® ^-measurable. 

By Monotone convergence theorem, 

I h {u,uj) = lim I h -y(u, w), 

7 —>-oo 

and therefore Ih is B(U) <g> J'-measurable. 

Case 3: Assume that a < h t (u,uj) for all (u,t,u). By jRW98l p. 665], 

ht(u,uj) = inf- {h t (V, w) + _ u '\} 

u' A 

is a normal integrand, so I h \ is B(U) ® ^-measurable by Case 2. By [RW981 
Example 9.11], h x Ph. as A —^ oo so, by the monotone convergence theorem, 

Ifi (it, cu) = lim I h \{u,u)). 

A—>o 


Thus, Ih is B(U) (g> ^-measurable. 

Consider now the case of a general nonnegative random Radon measure p. 
By [ HWY921 Theorem 3.42], p = p c + p d , where p c is atomless and p d is 
supported on the union (JJr 1 ] of graphs of some random times r l . We have 
the decomposition Ih = 1^ + w here the integral functionals are defined with 
respect to /i c and p d , respectively. Here I£ is measurable by the first part. We 
have 

Ih( u i^) ^ ^r‘(w) (^‘(u) i ( T ( w ))- 

i 

By the monotone convergence theorem, it suffices to prove that each term 
in the sum defines a B(U ) (8> ^-measurable function. The maps (it, w) H > 
(it, t(w), w), (it,t,w) i->- (u t ,t,u;) and ( x,t,co ) i-> h t ( x,uj) are measurable, so 
(tt,w) i->- h r ( li ,)(it T ( tJ ), cu) is a composition of measurable mappings. 

The last claim follows from Lemma E] □ 


7.3 Projections of extended-real valued processes 

Lemma 21. Let v be a measurable extended real-valued process and let p be a 
nonnegative random Radon measure. Then 


cu i —y 


v t (io)dp t (uj) 


/ 


vf (uj)dp t (co) 


v dp t {co) 


is T-measurable. 

Proof. When v is finite-valued and f \vt\dpt < oo a.s., the claim follows from 
standard monotone class arguments. For a nonnegative v, the claim then follows 
from the monotone convergence theorem. For an arbitrary v, the integral is thus 
a sum of ^-measurable extended real-valued random variables. □ 
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We will need the notion of an optional projection of an extended real-valued 
processes; see !KP161 . For a nonnegative real-valued process v, there exists 
a unique optional process °v satisfying (Q|; see (DM821 Theorem VI.43]. The 
monotone convergence theorem then gives the existence of a unique optional 
projection for a nonnegative extended real-valued process as well. For an ex¬ 
tended real-valued stochastic process v with T-integrable v + or v~ , we define 
°v = °(u + ) — °(v~). 

Lemma 22. Let /i be a nonnegative optional Radon measure and v an extended 
real-valued process such that v + or v~ is T-integrable. If E f v~ dp < oo, then 


E 



= E 



Proof. By [DM82 . Theorem VI.57], 


E 



= E 



for all nonnegative real-valued processes v. For nonnegative extended real¬ 
valued process, the expression is then valid by the monotone convergence theo¬ 
rem. As to the general case, 


E J vdp = E 
= E 
= E 
= E 


v + dp — E 
°v+dp - E 


dp 



] dp 


= E 



where the second equality holds since E f v dp < oo and the fourth since 
E J°v~dp < oo, by [DM821 Theorem VI.57]. □ 


7.4 Proof of Theorem [9] 

Lemma 23. Let p be an optional random Radon measure and h a convex normal 
integrand such that h*(x) + and h(y) + are T-integrable for some optional x and 
T-integrable y. If x is an optional process such that E f h*(x)~dp < oo, then 


E 


h*(x)dp = E 


°{h*){x)dp. 


Proof. Let A = {|a:| > M} for some strictly positive M € R. We have 










since the negative parts of both terms are integrable. 

Let A = a = l A x/\x\, and dp = |x| dp so that 

E j [l A h*(x)\dp = E J h*(a,X)dp 

for h t .(P,r]) := S ep ih t (/3, — rj). Indeed, by [Roc70l Corollary 13.5.1], we have 

\h*(a/\,w) if A > 0, 

K (a,A,w) = ^ (h*)°°{a,uj) if A = 0, 

+oo otherwise. 

Since A and a are bounded optional processes, we get from Lemma l22l and © 
that 

E J ft*(a, A )dp = E J°(h*){a,\)]dp. 

It is not difficult to verify from the definitions that epi h = epi 0 o epi h , so 
°(ft*)(a, A) = \°(h*)(a/\) by [KPlfil Theorem 10]. Thus 

E j [1 A h*{x)]dp = E J [l A °{h*){x)\dp. 

As to the second term, 1 A cx is bounded, so l A ch*(x)~ is T-integrable by the 
Fenchel inequality, and thus, by Lemma YF2 1 and 

E J [l A ch*(x)]dp = E J [t A c °(h*)(x)\dp. 

Thus 

E J h*{x)dp = E J Mhl{ x) W + E f[t AC °(h*)(x)W, 

which finishes the proof since the negative parts of both terms are again inte¬ 
grable. □ 

Lemma 24. Let h be regular and h as in Definition QJ Then f h(y)~dp, 
f h* [d6 a / dp)~ dp and f (h*)°°(dd/d\9 s \)~d\d s \ are integrable for every y E L 1 (C) 
and 6 E L°°(M). In particular, El/ and EJare proper. 

Proof. We define 0 € M°° by d0 a /dp = x and 6 s = 0, where x is from Defini¬ 
tion m The first lower bound in Definition |T] implies 


E / h(y) dp < E [(d6 a /dp ■ y) + a\ + dp < E 


+ E adp. 


The other terms are handled similarly, where, for the recession function, the 
latter lower bound implies (ft*)°°(x) > x-v. The bounds also give that EI^v) < 
E f adp and E (9) < E f adp , so EI^ and EJ are proper. □ 
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Lemma 25. Let h be regular and h as in Definition |7J Then Jh*(9) is Im¬ 
measurable and EJh*(6) = EJj l ,(9) for every 9 £ M°° . 

Proof. By [HWY92] Theorem 5.14], the Radon-Nikodym densities d9 a /dy, and 
d9 s /d\9 s \ are optional processes, so h*((d9 a /dy)) and (h*)°°((d9 s /d\9 s \) are op¬ 
tional as well. By Lemma [2TJ Jh* (6) is thus ^-measurable and EJh* is well- 
defined. By Lemma [231 J h*(d9 a /dy)~dy and J(h*)°°{d9 s /d\9 s \)~d\9 s \ are in¬ 
tegrate, so 


EJ~ h ,(9) = E 
= E 
= E 


I h* (d6 a /dy)dy + J (h*)°°(d9 s /d\9 a \)d\9 s \ 
h*{d9 a /dy)dy + E J {h*)°°{d9 s /d\9 s \)d\9 s \ 

°[h*{d9 a /dy)]dy + E [ 0 [(h*)°°(d6 s /d\6 s \)]d\6 s 


where the last equality follows from Lemma 1221 The lower bounds in Theorem [ 2 ] 
give that h[v) + and h*(x) + are T-integrable, so [KP16I Theorem 7] implies that 
°((h*)° c ) = (°(h*))°°. Consequently, EJ^(9) = EJ h *{9) by Lemma [251 □ 

Proof of Theorem 03 We get from the lower bounds in Definition [T| that h(v) + 
and h*{x) + are T-integrable, so, by |KP16i Lemma 3 and Theorem 8], we have 

h(v) > v ■ x — °a, 
h*{x) >°v-x-°a. 

Thus EIh(°v) < E J °ady , where the right side is finite by Lemma 1221 Similarly, 
EJ^ (9) is finite for 6 £ A4°° defined by d9 a /dy = x and 9 s = 0. The lower 
bounds also imply that Elh and EJh * never take the value — oo on 77 1 and 
M°°. Thus Elh and EJh* are proper. 

To prove that ( Elh + ^n 1 (D))* = EJh*, let v £ dom Elh and 9 £ dom EJh*. 
Since 8* D = {hl)°° , we have, almost surely, the Fenchel inequalities 

h(v) + h*(d9 a /dy) > v ■ (d9 a /dy) y-a.e. 

(h*)°°(d9 s /d\9 s \) > v (d9 s /d\9 s \) |(9| s -a.e., ‘ 

so I h (v) +S n i( D )(v) + J h *{9) > (v,9) a.s. and thus, (. EI h + 8 n i (D) )* < EJ h *. 

To prove the opposite inequality, we assume first that x = 0, so that h is 
bounded from below. Since h(v) + and h*( 0) + are T-integrable, KP16 Theorem 
9] implies that h(°y ) < °[h(y)\ for every y £ L 1 (C). Likewise, since 5d = 
((h*)°°)*, [KP.16] Theorem 9] gives S D (°y) < °8 cldom h(y ) for every y £ L l (C). 
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Thus, by Lemma C© EI h (°y) + 5 n i {D) (°y) < E[I~ h (y) + 6 cldom ~ h (y)\, so 


(EI h (v) + $-R,i( D ))*(9) — sup {(u, 6) — [EI h (y) + <5-^i(£))](u)]} 

ueK 1 

= sup {(y,9)-\EI h (°y) + 5 n i {D) \(°y)]} 

v&LHC) 

> sup {{y,0)-E[I~ h {y)+6 cldom ~ h (y)]} 

yeLHC) 

= E sup{ f ydO - I~ h (y) - S cldoinfl (y)} 

yGC J 

= EJ~ h ,(0) 

= EJ h *(9), 

where the last two lines follow from Theorem [7] and Lemma 1251 respectively. 

Now, let x be arbitrary optional with f \x\dy, £ L°° and define 9 £ Ai°° by 
d9/dy = x and 9 s = 0. We have 

(Elh + d n i( D ))*{9) = sup {(u, 9) — [Elh + <W(D)](^)]} 
v^n 1 

= sup {{v,9 - 9) - [EI n + <5 tc i (£)) ](u)]}, 

v&IZ 1 

where h t (v,uj) := h t (v,ui) — Xt(oj) ■v . It suffices to show that h is regular in the 
sense of Definition Q] with 5 = 0 since then, by the previous two paragraphs, 

(Elh + d-R'iD))* (Q) = EJ^, (9 — 9). 

Indeed, since h^(x,uj) = h*(x + Xt(u),u) and (hZ)°°(x,ij) = the 

right side equals EJh*{9). Defining h t (v,ui) := h t (v,ui) — xt(ui) ■ v we get 

h* {x,u) = h* t (x + x t (oj),bj), 

so |KP16l Corollary 3] implies °(h*) t (x,uj) = h^(x,ix). It is now easy to verify 
that h satisfies Definition (T] with 5 = 0. Thus (Elh + ^(a))* = EJh *. As 
to the subdifferential, we have 9 £ d(EIh + 5 n \( D ))(y) if and only if (Elh + 
d 7 j i ( £ ,))(y) + EJh* (9) = ( y,9 ), which is equivalent to having equalities in (©, 
which, in turn, is equivalent to the subdifferential conditions in the statement. 

It remains to show that Elh + <5 K i( d ) is lower semicontinuous. If v v —> v 
in 1Z 1 , we have (by passing to a subsequence if neccessary) v v —> v in the sup- 
norm almost surely (see [ DM82 ;. p. 82-83]) so, by Fatou’s lemma, the Fenchel 
inequalities © imply that 

lim inf[EI h (v v ) + 5 n i {D) {v v ) - {v v ,9 )] > [EI h (v) + d n i {D) {v v ) - (v,9)\, 
and thus, liminf [EI h {v v ) + 8n 1 { D ){v v )\ > [EI h {v) + S n i( D )(v l ')\. □ 
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